Skip to main content

Pierre Garrigues: Inference and learning of higher-order structure in sparse coding models of natural images

Movies Preview

movies
Pierre Garrigues: Inference and learning of higher-order structure in sparse coding models of natural images


Publication date 2009
Thesis seminar given by Pierre Garrigues, a graduate student in the Redwood Center for Theoretical Neuroscience at UC Berkeley. Given on April 10, 2009 at UC Berkeley.

Abstract:

Natural images, as complex and varied as they appear, have a sparse structure. That is, one can learn a basis set such that only a small fraction of the basis functions is necessary to describe a given image. Computing the sparse representation can be achieved by solving l1-regularized least-square, a problem commonly referred to as Basis Pursuit Denoising or Lasso.

I will first describe an algorithm to solve the Lasso with online observations, where I introduce an optimization problem that makes it possible to compute a homotopy from the current solution to the solution after observing a new data point. I will show how it can be used in compressive sensing of images, and in large scale sparse linear regression.

Finally, as the sparse coding model is not sufficient to describe the richness of image statistics, I will introduce a hierarchical sparse coding model where higher-order image structure is modeled and learned from data. The coefficients are distributed as a mixture of Laplace distributions, whose scale parameters control the statistical dependencies among the elements of the code.

comment
Reviews

There are no reviews yet. Be the first one to write a review.
SIMILAR ITEMS (based on metadata)
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 294
favorite 0
comment 0
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 208
favorite 0
comment 0
Community Video
movies
eye 264
favorite 0
comment 0
Community Video
movies
eye 255
favorite 0
comment 0
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 286
favorite 0
comment 0
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 991
favorite 0
comment 0
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 288
favorite 0
comment 0
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 531
favorite 0
comment 0
Community Video
by Redwood Center for Theoretical Neuroscience
movies
eye 438
favorite 0
comment 0